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(54) Dynamic cache preloading across loosely-coupled administrative domains 



(57) A caching server that provides faster access 
times for independently operating network elements. 
The caching server initiates information transfer and 
holds the requested information in its memory, instead 
of caching information transfer in response to user re- 
quests. The caching server preloads information from 
another server into its memory based on a set of prede- 
termined criteria. Such preloading preferably occurs 
during low usage time, such as nighttime. The informa- 
tion source determines which information is described 
in the catalog in accordance with one of a second set of 
predetermined criteria. For example; the catalog may be 
organized according to size and the information source 
will organize the catalog by file size. The caching server 
preloads as many often-used files as will fit in its cache 
memory 
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Description 



This application relates to networking and specifi- 
cally, to a method and apparatus for- caching in a net- 
work where the elements of the network are operatina 
independently. . ^ 

Recent years have seen a huge rise in the popular- 
ity of network systems, such as the internet. A network 
is.formed of independently operating elements that are 
interconnected in a way that allows them to transmit in- 
formation. For example,,:a firs;.; network element can 
transmit World Wide Web- pages to.a.second network 
element. The World Wide Web altows a user to use "web 
browser" software on his computer systemjto.view "web 
pages" stored on other systems in the network Similar- 
ly network elementspao transfer files to other network 
elements via File Transfer Protocol (FTP). , : ,. 

The amount of information transmitted over net- 
works such as the internet has grown and will continue, 
to grow in the future. While.lhe overall amount of infor- 
mation being transferred has grown, the amount of in- 
formation being transferred during a day still varies at 
different times of the day A time of day when the most 
information is being transferred is called a "peak usage 
time." A time of day vyhen.a relatively small amount of 
information is being transferred is. called s- "tovvjusage 
time.," For example; a network that allov^s a consumer 
to download information to a.persona! computer using 
a cable modem might have.a-peak usage time when 
people get home from work and a low usage time in the 
middle of the night when people are asleep It is desir- 
able that usage of the network be evened out as much 
as possible. It is also desirable that response time be 
increased as much as possible. 

Moreover, in conventional networks, various ele- 
ments of the network have different goals. For example 
in the above, mentioned consumer network, a centrally 
located network element may have a goal of sending as 
much information as possible out over the network In 
contrast, a "local" computer may have a goal of giving 
Its" users the best response time possible. 

Local computers often "cache", incoming informa^ 
tion. For example, a web browser may save in its mem- 
ory a copy of the ten most recent pages viewed by the 
user. That way if the user wants to view any of the 
cached web pages, the browser software does not have 
to send a request for, the web page out over the network 
Instead, the browser can merely get the cached web 
pagefrom its m.emory. The browser can access its mem- 
ory much faster than it can request a web page and re- 
ceive It over the network. Thus, caching saves the time 
othenwise required to fetch the web page from over the 
network.. Local computers often cache the most recently 
accessed information so, that the information will be 
available should the user request it again. A problem 
associated with conventional caching is that the user 
must wa,1 for infomiation to be downloaded into the local 
computer when the user makes a first request for the 



informaticn. (Caching is performed In response to a user 
request for information). A second problem is that the 
information to be cached is often requested and down- 
loaded dtring peak usage times. 

5 Particular and preferred aspects of the invention are 
set out in the accompanying independent and depend- 
ent claims.. Features of the dependent claims may be 
combined with those of the independent claims as ap- 
propnateand in combinations ot!ier than those explicitly 
'0 set out in the claims, . ' 

The present invention overcomes the problems and 
disadvantages of the. prior art by^implernentlng a cach- 
ing ser/er.that provides faster access, times for inde- 
pendently operating network e.'enr.ents. Such independ- 
'5 ently. operating network elements are said to have 
^loosely Goupled administrative.domains. " !n a preferred 
embodimentof the present invention, the.caching serve' 
initiatesiinformation transfer and holds the requested in- 
formation In- i!,3 memoryj instead^of caching Infcrmation 
20 transfer in; response to user requests. 

.' V In a preferred.embodiment of the present invention 
the caching server preloads information from another 
server into its memory based on a set of piedetermined 
cntena., Forf example;„the,caohingseiwmay download 
-5 as.-,Tany rf .the largest^files as.wil! fit in its cache memory. 
Such/preloading preferably occurs during low usage 
time; Specifically, the caching sen/e.>- requests a "cata- 
log'' of available information from an information source 
such as anothen server The information source sends 
30 the catalog over the network. The caching server then 
decides which information' it wants to preload and re- 
quests that, information from the information source 
Once the information is received, the caching sen/er 
holds the information irr a cache memory so that the in- 
3S formation: will be available when requested by a user. 

Cache preloading has two main benefits: 1) it elim- 
inates the latency time associated with accessing infor- 
mation requested by a user for the first time and 2) the 
information fetch between ■ the information source and 
^0 the caching server can take place during off-peak hours 
thereby .reducing the network load at peak times. 

In a preferred embodiment of the present invention 
the information source determines which information is 
described in the catalog in.accordance with one of a set 
^ of .predetermined criteria. For example, the catalog may 
be organized according to size and the infcrmation 
source will organize the.catalog by file size. As a second 
example, the catalog may be organized according to the 
files mostoften downloaded by users. In this case the 
caching server will preload as many often-used files as 
will fit in Its cache memory. As a third example, the cat- 
alog may be organized according to which files adver- 
tisers have paid to place in the catalog. In this case the 
caching server will preksad as many of these files as will 
s5 fit in Its cache memory. 

In accordance with an aspect of the invention, there 
IS provided a method for quickly accessing information 
in .a network that-includes an origin system connected 
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to a caching server, the method comprising the steps, 
performed by the caching server of: requesting a catalog 
from the origin system that lists documents available 
from the origin system; receiving. the catalog from the 
origin system; requesting a document described in the s 
catalog, the document requested according to a prede- 
termined criterion of the caching server; receiving the 
document from the origin system; and storing the doc- 
ument in a cache memory of the caching server.' 

In accordance with another aspect of the invention, io 
there is provided a caching server having ax;ache mem- 
ory, the caching server being part.of*a network that in- 
cludes an origin system connected^toithesrcachmg^serv- 
er, the caching.server cbmprisingra first portion config- 
ured to request a catalog-from the origin system that lists *5 
documents avatlabletfrom the^ origin systempa second 
portion configured toTecejve.lhe catatoig f ronn.lhe:origin 
system;^a third portion configured to request aidDCument 
described Hn the catalog^the document .requested aE>- 
cording lo a predetermined criterion of the cachingserv-- 20 
er; a fourth portion configured to rece^ive th&docuriient 
from the origin^system;i and a fifth portion. configured to 
store the£documertt.:in the. cache nnemory.- ' : . -. 

• Adwantage3;offth©.inwention*wUl^e set forth in part- 
in the description which; follows lar^diin^. parr wit> beiobvis 2S 
ous from the descript ton or. may be -learned by pT.acftice' 
of.the invention. The objects and advantages ot 'the ini- 
vention will be realized and attainedtby means of the 
elements and combinations particularly pointed out in 
the appended claims and equivalents, v 30 

: Exerrrplary; embodiments of the: invention are de- 
scribed hereinaften. by waycof example only, with refer-, 
ence to the accomparrying.drawings.Hn. which: ' ^ : 

Figure 1 is>a block diagram of a data i processing 
system in accordance with a preferred embodiment of 35 
the present invention. > . :>:r,v.; 

Figure 2 is a 'diagram showing steps of. a method: 
for preloading a caching server. i.". - .. r 

Figure 3 rs a diagram showing steps of a method 
for fulfilling a user's request lor information, r: : . 40 

Figures 4a through 4c. show examples of- possible 
catalog formats. .' ■■ ; cv... 7 ' • r r- . * - ^ 

•Reference^ will. now: be- made in detairto: thdrpre^ 
ferred embodiments of the invention, examples of which' 
are illustrated in the accompanying drawings. Wherever ^5 
possible, the- same reference.' numbers wilKbeyused 
throughout the drawings. to jrefer'to the :sartie or ilike 
parts, .n • ".I . ^ ^ -* ~ - r;t.i' 

Figure -I fisa .bk^ck diagra/n. of a computer network 

100 in accordance with a preferred'embodiment of the so 
present invention. Computer network 100 includes an 
origin computer systenrr 1^)1oand a caching computer 
system 151. Origin system 1 01 and caching system tSI 

are connected via connection 1 30. The computer sys- 
tem 100 can be any type ot network, such as the inter- 55 
net, a LAN, a WAN, an intranet, etc. , that allows systems 

101 and 151 to communicate with each othei-. Origin 
system 101 and caching system 151 operate independ- 



ently and communicate using any known protocol, such 
as Hyper Text Transfer Protocol (http). Although only 
two systems 101 and 151 are shown, it should be un- 
derstood that additional systems can be included in 
computer networ1< 100 without departing from the the 
present invention. 

Origin computer system 101 includes a processor 
102 and a memory 104. Memory 104 includes origin 
server software 1 1 2 and a catalog 1 1 4. Catalog 1 1 4 con- 
tains, for example, a description of information available 
from origin system 101.. System 101 preferably con- 
nects to a display device 1 32 and an input device 1 34, 
which can be any of a preferably connects to a display 
device -1 32 and to ari-input device 134. which can be 
any ofia vvide range of varylng"^l/0 devices, such as disk 
drives, keyboards,- moddms, network adapters, printers, 
and displays.. Respective computer readable devices 
136\ such as a dfsk drive or CD'FtOM drive, are shown 
connected to'^orlgin systerfi' tot- and caching system 
151. Origin servetr software *lt2 and Caching server 
software 162-are preferaibly Ibaded into memory via de- 
vices 1'36.'! * - ■ 

' Caching computer system ,151 includes a processor 
152 and-a memory 154. Memory 154 includes caching 
server. software 162 and a catalog 164 transmitted firom 
oiagin system t-01'. Figur^^l 'also shoWs a cache' memory 
174.vCache memory -r74"'rriayt('e a parl'of rriembry-104 
(as shownj-or^may be a separate mertib^y. Cache' mem- 
ory 174 has a predetermined maximum size. In the de- 
scribed embodiment, caching system 151 is connected 
to client#1 190 and client#2 192. In the described em- 
bodiment. ctient#1 190 and taching system 151 jointly 
form a caching server 194. In other embodinhents, cli- 
ent#1 may be located in either the same or a different 
computer as caching sy stern 151. In still other preferred 
embodiments, -caching -system 151 performs the func- 
tions of client#T'190. Client#2 may be located^in either 
the same or a different computer as caching system 
151.' 

Preloading of caching system ISI^is allowed from 
origin system 101 , where the priorrties of the entities ad- 
ministrating the systems ^0^ and are 151 different. For 
example, the origin system 101 will want = to "push out** 
as much information as possible, while the caching sys- 
tem 1 51 is willing only to caches a certain amount of in- 
formation. Origin' system 101 may be; . for example, a 
large, centrally located server that siores a large number 
of http documents, such as web pages and files. Cach- 
ing system 151 may be, for exaihnpre;- a 'regional Server 
accessible by^clients in a geographical region. A typical 
network may include muKiple origin systems 101 and/or 
multiple caching systems 1 51 . 

V i Figure 2 is a diagram showing steps of a method 
for preloading caching system 151 in^accordance with 
a preferred embodiment of the present invention'.' The 
figure is divided intothree areas, representing, respec- 
tively, Client#1 190. caching system 151 and origin sys- 
tem 101- In the described embodiment, the client and 
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the servers communicate with one another via the^htto 
protocol, although other suitable protocols could be 
used. Processor l52 executes caching:serv3r software 
162 to perform the steps of the.middle column. Proces- 
sor 102 executes origin server software 112 to perform 
the steps of the right-most column. Glier,t#1 1 90 and cli- 
ent#2 192 preferably contain a processor executing 
software performing the illustrated steps. As discussed 
above Figure 1 shows client#1 1 90 as a separate proc- 
ess, which may or may not run on a separate machine 
n gn alternate embodiment„.the functions of client#1 
190 are perfomied.by caching server software 162 

In step 202, client#1, 190 initiates a request for a 
catalog tp caching system 1 ST. In the described embod- 
iment^ client#1 1 90.3ends 5uch a request at a predeter- 
mined time, such as in the middle of the night. It is de- 
sirable^that the request of step 202 be performed at a 
time when the network is not busy., Such-timing helps to 
reduce network load at peak times. In siep 204, caching 
system. 151 sends a request for.acatalog to.origin sys 
tern 101. In step 206, origin system 101 sends the cat- 
alog 114 to caching system 151. In step 208, caching 
system 151 sends the catalog to client#1 190- 

Steps 210 through 220 are perfomied multiple 
times unt clienf#l 190. determines, that .cache memory 
174 IS full, (or that son3e-,rr.axirr,um amowtvof cache 
space IS filled). Alternately, client#1 1 90 may send a list 
of information to preload to caching -system 151 and 
caching system 151 will load as many .of the items on 
the list as will fit in cache memory 174. In step 210 cli- 
ent#1 1 90 requests an item in the catalog from caching 
system 151. Caching system 151 sends the request"o 
ongin system .101.. which.retums the requested item 
Caching system 151 caches the returned item in cache 
memo^ 174. Figure 2 shows that the item is then for- 
warded to client#l 1 90, which discards it, but may keep 
mfom^ation about the item, such as the size. Alternately 
caching system 151 may simply cache the item without 
sending it to clientfl 1 90. Thus, at the end of step 21 6 
infomiation has been preloaded into caching system 
151 and IS awaiting user requests for the information 

.on '^T ^ ^'^P In which client#;i 

190 sends special instructions to caching system 151 
These special instructions may, for example, specify 
that certain information in cache memory 1 74 should not 
be discarded from cache memory for a predetermined 
amount cf time. As another example, the special instruc- 
tion may instruct caching system 151 to immediately dis- 
card certain information in cache memory 174 The in- 
formation may be specified, for example, by its URL 
(Unifomi Resource Locator). Alternately, the special in- 
struction^may.instruct the caching system 151 to delete 
(or save) infonmation in a last-in. first-out order or in 
some other appropriate order 

, , '''^"'■^ 3 is a diagram showing steps of a method 
for fulfilling a user's request for information. The steps 
of Figure 3 are performed after !he caching system 151 
has preloaded some information into cache memory 



174, as shown in Figure 2. In the example, the user is 
logged onto client#2 1 92. In step 302. the user requests 

T'ITJ°Z "'^ by URL. If, in 

step 304 the requested information has been preloaded 
and exists in cache memory 1 74, the information is cop- 
ied from cache memory 1 74 and sent to client#2 1 92 If 
in step 308, the information was not preloaded then in 
step.,310; caching system..151 requests the information 
rom origin system 1 01 , which returns the requested in- 
^0 formation.. In- step 314, caching system 1 51 stores the 
information in cache memory- 174. and, in step 316 
sends thecinformation to the requesting client. Caching 
system 151 determines- whether certain infomiation is 
present inieache. memory 174 via any of a variety of 
'5 known cache memory techniques 

Note that step 31 4 may involve purging-(discarding) 
rtems from cache- 174 to make room for new items If 
caching system 15l..has received special instructions 

eo ■S^ff'^'' ^^''^^ information, then in step 

3d 4,. thatjinformation will not be discarded from cache 
even if it would.normally be next in line to be discarded' 
Figures 4a,through. 4c show respective examples 
-of .ormats of catalog 114; Each example format includes 
a-section or row innhs.catalcg, for each file or URL that 
■ss isjavaitoje fotte-downtloaded from the origin system 
These tormats are provided by way of example only and 
^re not.-n^eant to limit the scope of the present invention. 
Catalog 1 1 4 is preferably an http document of type »text/ 
plam. Figure 4a shows a format in which catalog 114 
-0 includes two fields: a Uniform Resource Locator (LrL) 
Jeld402 and a size field 404. .The catalog may optionally 
be organized iby increasing or decreasing size 

.Figure .4b shows a format in which catalog 114 in- 

cludesthre8flelds:aURLfield410.asizefield412,and 
a # of t,mesdGwnloaded".field 414 (also called a "pop- 
uJarity- fieJd), Alternately, the popularity field 414 could 
be omitted and the catalog could simply be sorted bv 
ascending ordescending popularity value 
'\ f'^'' 4c,shows a format in which the catalog in- 
^0 eludes three fields: a URL-field 420, a size field 412 and 
ai desirability field. ' Alternately, the desirability field 41 2 
could be omitted and the catalog could simply be sorted 
by ascending or descending desirability -In this exam^ 

45 Tn. Tn 'T'"^ """'^'^^ ^ criteria defined in origin sys- 
tem 1 01 ..For, example,, if an advertiser had paid a pre^ 
miumjo have his. informatiai, placed into the catalog 
.he. information, would .havaa high desirability value in 
he catalog, aher examples of catalogs might have the 
URLs sorted according.to their PlCS rating, or any sim- 
5" liar rating :which rates the cbntent^of files . : 

y - Caching.system il Sl reviews the contents of cata- 
log.:1il4 and determines wf.ich.available information de- 
scribed in catalog 114 it should preload.. This determi- 
nation is made in accordance with a number of criteria 
stored in the memoiy of caching system 1 51 . A simple 
criteria, for example, is to simply preload files in the cat- 
alog by size, largest first, until cache memory 1 74 is full 
(or a predetermined cache size limit has been reached) 
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Another possible criteria might be that caching systenn 
151 preloads according to both the size of the file, the 
available cache space, and -the 'popularity" or "desira- 
bility" of the file. Another possible criteria nnight'be that 
the caching system 151 preloads in accordance with 
one of the criteria described above, but'does not, under 
any circumstances,' download information on a "do not 
download" list stored in its rinemory. For exempli, certain 
caching systems . 151 might never want to download 
adult material or material from a predetermined informa- 
tion source. As can be seen from the above examples, 
the criteria used to determine what information t6 down- 
load is-affected somewhat by; what information is^ avail- 
able in catalog 114. A large number of - catalog formats 
and caching system criteria are compatible with embod- 
jmenis.ol the present invent ion- . . o:.- 
■ 'In some embodiments^ origin t system ilOn' ^ives 
:hinis" to the caching system/cUent as to:v\4ien Itshotrid 
next rcfquosi acatalGg.iTheses hirrts may be serrt as part 
of the chlhIoq or maycbe sent in. a 'separate /administra- 
tive rnussngo Fof ^ example,- if Abe catalog-.is normally 
updrtlod : every Iwonly-four hours, origin systerrii 101 
migh!. suggest that Ihe-catalog be downloaded b/ the 
caching, systcmr we ry: twentyitour. hours, if; however, 
some imp>crtant c vent -iis^dccuhringl:? origin' sy '-tern/ ft 01 
migh! euggost t>^artho catalog be down toatied more' fra- 
quently because^ it -js being updated rriore frequently by 
origin system 101.. . ^- ^ j ^ ; 

Ip-^a proforrod embodiment, if origin systenn 101 is 
accessed by rTUiliiple;caching servers, a different cata- 
log can bo sent to each caching server 1 94. The catalog 
is dynamically generated based on, for example; the ac- 
cess pattern generated by the particular caching server 
as observed by the origin. system; Alternately, catalogs 
are determined by p^iicy.decisions at the origin- system 
1 01 . For example, the catalogs sent to a certain caching 
server may not' contain adult material!' K'n- : ^ 

In summary, an embodimentof the invention allows 
a caching server, .preferably includlngia client and a 
caching system, to initiate a^request for a catalog.of 
available http documents.: This request is rriade at night 
or during a slow time on:the network.- After the catalog 
is received, the caching sen/er decides which of the doc- 
uments in the catalog . to preload into a cache memory.' 
Thus,: the preloaded documents will be available in the 
cache memory of ihe caching server when a user re- 
quests them. The caching server can decide that some 
or all preloaded documents should not be purged from 
its cache for a predetermined time. . ■ *- , 

Other embodiments will be apparent to those skilled 
in the art from consideration of the specification and 
practice of the invention disclosed herein. .!t is intended 
that the specification and examples .be considered as 
exemplary only. • •: 



Claims - 

1. A method for accessing information in a network 
that includes an origin system connected toa cach- 
5 ing server, the method comprising the steps, per- 
formed by th^ caching sen/er of: 

requesting a cdtalog from the origin system that 
lists documents available from the origin sys- 
10 tem; • 

* receiving the catalog from the origin system; 
requesting a docOment-described in the cata- 
log, the document requested according to a 
• pr^dfetermined?criteribn;of the caching server; 
'5 receiving the document from' the origin system; 

L and * " . ^ • • : 
* - i> ^ storing the document iha cache memory of the 
:'i n~ ! caching server. ■ - ■ 
priif ' . •-)' 

^20 2:^:- The -method of clairri n , further including the steps 
■ df:*^ -. " - ' ' V • . 

receiving, by the caching server, a request tor 
• the docufnent frorn a u&er;- and 
V ic nv.i I v: se'nding,' 'by the' caching server; the document 
Gr!-s:j VstoFed ^in^ the^csiehe -rriomory to the user. 

3. The method of cidim 1 , wherein the step of "request- 
ing a catalog from the- origin system performed dur- 

30 ing a low usage time of the network. 

4. The method of claim 1 , wherein the caching server 
i includes a client and a caching system and wherein 

■ the step of requesting a catalog from the origin sys - 
-35 tem includes the steps of: 

sending the request for the catalog from the cli- 
t ent to the caching ^system; and • 

sending the request for the catalog from the 
40 } . caching system ic the origin system. 

5. - The method of claim 1; wherein the caching server 
' ' includes a client and a caching system and wherein 

' the step 'of requesting a document described in the 
45 catalog includes the steps of: 

sending the request for the catalog from the cli- 
ent to the caching system; and 
sending the request foir the- catalog from the 
50 caching system to the origin system. 

6. The method of claim 1, wherein the criterion used 
by the caching server to determine whether to re- 
quest a document from the catalog is based on the 

55 size of the document. ' 

7. The method of claim 1, wherein the criteVion used 
by the caching server to determine whether to re- 
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quest a document from the catalog is based on a 
rating associated with the document and stored in 
the catalog. 

The method of claim 1. wherein the criterion used 
by the caching server to determine whether to re- 
quest a document from the catalog is based on a 
list of non-acceptable document names. 

9. The method of claim 1, wherein the network in- 
cludes a second caching sen/er and the first and 
second caching sen/ers receive different catalogs 
from the origin system. 

10. The method of claim 1. wherein the network in- 
cludes a second caching sen/er and the first and 
Xhe se(X)nd caching sen/ers request different docu- 
ments from the origin system. ' 

L'dtr*^°t°' "^^ °^i9in systern 

and the caching sen/er use http protocol to commu- 

n ICal©. • 
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a fourth portion configured to receive the doc- 
ument from the origin system; and 
a fifth portion configured to store the document 
in the cache memory. 

16. Thecachingserverofclaim 14; wherein the caching 
server includes a client and a caching system and 
wherein the first portion includes: 

a sixth portion configured to send the request 
for the catalog from the client to the caching 
systerfi; and ■ - ■ ' « 

a seventh portion configured to send the re- 
quest for the catalog from the caching system 
to the origin system.- 



16. 



12. The method of claim 1, wherein the caching server 
.nc udes a client and a caching system and further 
including the steps of: ; i 

sending, by the client to the caching system an 
instruction to retain the document in the cache 
memory for a specified amount of time- and ^ 
retaining the document . in the cache memory. 

by the caching system, forthe specified amount 

OT time. 



13. The method of claim 1. wherein the caching server 3S 
nc udes a client and a caching system and further 
including the steps of: 
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sending, by the client to the cach ing system an 
instruction to purge the document from the 
cache memoiy; and 

purging the document from the cache memory 
by the caching system, 

14. A caching server having a cache memory, the cach- 
ing sen/er being part of a network that includes an 
origin system connected to the caching ^en/er the 
caching server comprising: . . 

a first portion configured to request a catalog 
from the origin system that lists documents 
available from the origin system; 
a second portion configured to receive the cat- 
alog from the origin system; 
a third portion configured to request a docu- 
mentdescribed in thecatalog. the document rel 
quested according to a predetermined criterion 
of the caching server; 
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A computer prograrn, product comprising: 

a computer usable medium having computer 
r - readable code embodied therein for causing 
,- access to info.'mation stored on a network hav- 
ing a ongin system and a caching server the 
computerprpgramproduct comprising 

^.;.g:uredtaci&agW-acomputirt6effe^^ 
• : ^ catalog from the origin system that lists doc- 
uments available from the origin system- 
computer readable program code devices con- 
figured to cause a computer to effect receiving 
the catalog from the origin system- 
computer readable program code devices con- 
figured to cause a computerto effect requesting 
a document described in the catalog, the doc- 
ument requested according to a predetermined 
criterion; 

computer readable program code devices con- 
figured to cause a computer to effect receiving 
the document from the origin system; and 
computer readable program code devices con- 
figured to cause a computerto effect storing the 
document in the cache memory. 
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